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Based on a specific model with U(3) family gauge symmetry at 10 3 TeV scale, we show 
its experimental signatures to search for. Since the gauge symmetry is introduced with a 
special purpose, its gauge coupling constant and gauge boson mass spectrum are not free. 
The current structure in this model leads to family number violations via exchange of extra 
gauge bosons. We investigate present constraints from flavor changing processes and discuss 
visible signatures at LHC and lepton colliders. 



Oh 1 



Oh 



X 



Abstract 



PACS: 12.60.-i, 14.70.Pw, 11.30.Hv, 13.66.-a, 



CN ■ Keywords: family gauge symmetry, family number violations, LHC extra gauge boson 

> i search " 

en 
t> 

^-, 

1^! . 1 Introduction 

O 

In the current flavor physics, it is a big concern whether flavors can be described by concept of 
"symmetry" or not. If the flavors are described by a symmetry (family symmetry), it is also 
interesting to consider that the symmetry is gauged. (For an earlier work of gauge SU(3) symme- 
try, for example, see Ref.pQ.) Most models with a family gauge symmetry have been introduced 
for the purpose of understanding mass spectra and mixings of quarks and leptons. However, it 
is difficult to exclude such models by the present and near future experiments, because in most 
models the gauge coupling constant gf and gauge boson masses are free parameters. In the 
present paper, we pay attention to a specific model with a U(3) family gauge symmetry which 
was proposed by one of the authors (YS) [21 [3]. In contrast to the conventional U(3) family gauge 
model, the present model has been introduced to explain the charged lepton spectrum with high 
precision. Therefore, the gauge coupling constant gf is fixed with respect to the standard elec- 
troweak gauge coupling constants as <?//2 = e = gi sin#vf > and the mass spectrum of the gauge 
bosons is also fixed (see eq.(8) below). As a result, we can give definite predictions, which may 
allow these gauge bosons to be clearly detected or excluded in forthcoming experiments. 

First, let us give a short review: "Why do we need a family gauge symmetry?" In the 
charged lepton sector, we know that an empirical relation [5] 

m e + m^ + m T 2 

J\ = - — ■ — — — 7 = — (1) 

\y/m e + y/rrin + ^/m T ) z 3 



is satisfied with the order of 10~ 5 with the pole masses, i.e. K pole = (2/3) x (0.999989±0.000014) 
[5], while it is only valid with the order of 10 -3 with the running masses, i.e. K(fi) = (2/3) x 
(1.00189 ± 0.00002) at [i = mz- In conventional mass matrix models, "mass" means not "pole 
mass" but "running mass." Why is the mass formula (Q]) so remarkably satisfied with the pole 
masses? This has been a mysterious problem as to the relation ([TJ for long years. Recently, 
a possible solution to this problem has been proposed by one of the authors (Y.S.) [21 [3]: The 
deviation of K(fJ>) from K p is caused by a logarithmic term m e j log (/i/m e j) in the running 
mass. It was advocated that a family symmetry is gauged, and that the logarithmic term in 
the radiative correction to K(fi) due to photon is canceled by that due to family gauge bosons. 
(This does not mean m e j(/i) = m P ° e .) In order that cancellation works correctly, the left- 
handed lepton field V>L and its right-handed partner ipR should be assigned to 3 and 3* of U(3) 
[B], respectively, differently from the conventional assignment [T] (V'LiV'-r) = (3,3). 

The assignment (iPl,iPr) = (3, 3*) can induce interesting observable effects. In the conven- 
tional assignment, a family gauge boson A 1 - couples to a current component (J^)l = w'lPl^Li + 
VrI^Rii while in the present model, the gauge boson A 1 , couples to 

(J/iYi = i^in^u - $RH^ R - (2) 

In general, the currents (2) cause the violation of individual family number Nf by |AiVj| = 2. 
The influence of the family number violation is determined by the family gauge coupling constant 
gf and each family gauge boson mass rrifij = m{A :) i ). Here, for simplicity, the family current 
structure has been presented by a field ip as a representative of quarks u and d and leptons e 
and v. For example, the charged lepton current component (J p ) 2 is given by 

{ j p)i = fiLl P eL - eRj p HR. (3) 

This causes an e (or [i) lepton- number-violating process e~ + e~ — > n~ + n~ through the effective 
current-current interaction 

C e ff = 9m [mp{1 _ 7s)e] [mP{1 + 7s)e] + hCi (4) 

where Gf 12 /y/2 = g 2 f /8(m fl2 ) 2 (m fl2 = m(A\)). 

In order to realize the cancellation mechanism between photon and family gauge bosons, 
gf should be related to the electric charge e as 

-g} = e 2 = g 2 2 s\n 2 e w , (5) 

where g 2 is the gauge coupling constant of SU(2)l. In [2j [3] a speculation is given that the 
relation ([5]) may originate from unification of SU(2)l and family U(3) gauge symmetries at 10 2 - 
10 3 TeV scale; the level of tuning of the unification scale required in this scenario is estimated 
to be a factor of 3 to match the present experimental accuracy of eq. ([1]). This model of charged 
lepton sector has been constructed in the context of an effective field theory with a cut-off scale 
A ~ 10 3 -10 4 TeV, assuming this unification scenario and incorporating the family U(3) gauge 
symmetry. The masses of A\ are predicted to be in the 1 — 1000 TeV range. 



Thus, the ratio of the coefficients of the four-Fermi contact interactions is given by 



^/y . 2 _ ( m w \ 5.98 x 10 
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4sin 2 6W — = ,7"™ - (6) 



G7 = 4Sm ^V^ = (m /y [TeV])^ 

Here Gfij/y/2 = g^/Sm 2 ^- and Gp/\j2 = g|/8m^/. In this model, Yukawa coupling constants 
Ye of the charged leptons are effectively given by 

^i^^Dw^u ( 7 ) 

0=1 

where <£ e is a scalar with (3,3) of family U(3)xO(3) symmetries. (Here, the family U(3)xO(3) 
symmetries originate from a U(9) family symmetry [3], and only U(3) gauge symmetry can 
contribute to the radiative correction of the running masses of charged leptons below the cut-off 
scale A, at which the charged lepton mass relation (1) is given exactly.) In other words, the 
VEV matrix (3> e ) is given as (3> e ) = diag(ui, V2, V3) oc diag(^/m e , */m^J, y/m T ). [A prototype of 
such an idea for the charged lepton masses is found in Ref. [7] related to the mass formula ((TJ.] 
Then, the gauge symmetry U(3) is completely broken by (<£ e ) 7^ 0, so that the gauge boson 
masses mfij are related to the charged lepton masses as [3] 

{mfij) 2 = m 2 (A{) oc m ei + m ej . (8) 

The mass spectrum (8) is essential in this model. For example, if we assume (Ye ){ oc 
^2k({&e)i)({&e)i : }, we cannot obtain the relation (8). It is assumed that other scalar VEV's 
with non-zero family charge, if they exist, have much smaller magnitudes than ($ e ), such that 
they do not affect the family gauge boson spectrum. This is crucial to protect the cancellation 
mechanism within the present scenario. 

The purpose of the present paper is to discuss how to test this family gauge symmetry within 
the above model. We note that this model is incomplete, e.g. the quark and neutrino sectors 
are not included, anomaly of the family gauge symmetry is not canceled^ We focus only on the 
family gauge interactions, which are fairly independent of the details of the model. We examine 
the interactions with |AA^| = 2 via the gauge boson A\. In the next section, we estimate a 
lower bound of its mass mf\2 from the experimental limit on the branching ratio of a rare kaon 
decay K + — > 7r + ^~e + , assuming that the quarks are assigned to multiplets of the U(3) x 0(3) 
family gauge group in the same way as the charged leptonso We also discuss K°-K° mixing and 
muonium into antimuonium conversion. (For a review of searches for signatures with | AJV* | = 2, 
see, for example, Ref.[8j.) In Sec. 3, we investigate possible signatures in collider experiments, 
such as e~ + e~ — > [±~ + n~ production. Since the mass of the lightest gauge boson A\ may take 



1 Above the scale of the family symmetry breaking the gauge anomaly should cancel. We assume existence of 
such a more complete model, in which all the fermions except the Standard-Model fermions acquire masses of the 
order of the symmetry breaking scale (~ m/y) and decouple from the low energy spectrum. 

2 This is the only (minimalistic) assumption we impose on top of the original model [3] . 



a value within 1- 10 TeV range, we may expect a production p + p — > A\+ X — > (e + e~) + X at 
LHC. We estimate the production cross section and decay rate. Finally, Sec. 4 is devoted to a 
summary. 

2 Lower bounds for the gauge boson masses 

First, in order to see more details of the characteristic current structure ([2]), we discuss the flavor 
changing neutral currents relevant for /j, and e. According to eq. ([2]), the current (J p )f can be 
written as 

{ j p)i = fiLlpez - e R jpHR = (J v ) p - {Ja) p , (9) 

where (Jy) p = (l/2)(p,j p e — ej p fi) and (Ja) p = (l/2)G"7 P 75e + e7 p 7 5 /i). The vector current 
Jy and axial current J P A have CP = — 1 and CP = +1, respectively. However, this does not 
mean that the effective current-current interactions cause CP- violating interactions. In fact, 
the current (J p )\ is written as {J p )\ = ^l! p ^l — P-r7 p &r = — (Jv) p — {JaY-, so that the effective 
current-current interaction is CP conserving: 

C eff = 4 ^ (Jp) 2 (jP) i = _ A Gjv ^ Jv)p{Jv y _ {Ja)p{Ja) p\ . (10) 

Next we discuss rare kaon decays. Note that, in this model, the family number i = (1, 2, 3) is 
defined as (ei, e-z, 63) = (e, /x, r) in the charged lepton sector. If we assume {d\, d,2, d^) ~ (d, s, b) 
in the down-quark sector, the gauge boson masses rrifi2 can be constrained by the rare kaon 
decay searches. In general, a down-quark mass matrix M^ is not necessarily diagonal in the 
diagonal basis of the charged lepton mass matrix M e . For simplicity, we assume that M^ is 
Hermitian and consider only a d-s mixing 



(11) 



where the down-quark mass matrix M^ is given in the flavor basis in which the charged lepton 
mass matrix M e is diagonal, and M& is diagonalized as UlMdUd = diag(md,rn s ,Tnb)- In this 
case, the down-quark current (J p )\ is given by 

(4 d) )l = AiA - d\^ SR 

(12) 
1 _ 1 _ 1 

= 9 ( s > d ~ ^ s ) ~ 2-( s 7M75d + d7 p 7 5 s) cos 26 + -{sj^ 5 s - d'y^d) sin 29, 

where the first, second and third terms have CP = —1, +1 and +1, respectively. Note that the 
vector current is independent of the mixing angle 9. (However, this is valid only with the mixing 
matrix eq. (fTTj) .) 






As an example of the s-d current, let us discuss a decay of neutral kaon into e + fi^. 
In eq. (|12p . only the second term is relevant to a neutral kaon with spin-parity 0~, which has 
CP = +1. Since the observed neutral kaons K$ and Kl have CP = +1 and CP = — 1, 
respectively, in the limit of CP conservation, we must identify the second term in eq. (|12p as 
K s (not Kl). Hence, a stringent lower limit of raj 12 cannot be extracted from the present 
experimental limit [5] BR(K L — > e ± /i T ) < 4.7 x 10~ 12 . 

Instead, the lower limit of m/12 can be obtained from the rare kaon decays K + — > tt + + 
e^ + /i^. The K — > tt decay is described by the first term (vector currents) in eq. (|12|) . which 
can be replaced by z(vr~ dp K )■ Hence, 

C eff = 2(G /12 /v / 2)(s 7p d)(e 7 V - m P e) 

(13) 
=* 2(G /12 /V2)f(vr- 5 P K+)(eYn - UYe). 

Since the effective interaction for K + -> ifi^v^ is given by £^ eafc = {gl/2my V )V us (s L '~i p u L ){jl L ^ p u lJLL ), 
the ratio BR{K + -> ir+e ± n T )/BR(K + -»• vrV + ^) is given by 

i?= [2-(g/i2/^)] 2 =67 , 27 ^V, (14) 



2|K s | 2 (l/v / 2) 2 (G F /V2) 2 " ' W/12; ' 



in the approximation m(-7r + ) = m(7r°) and m(e ) = m(ua) = 0. The present experimental limits 
[5] BR(K + ->■ 7r+ e -^ + ) < 1.3 x 10~ n and BR{K + ->• vr + ^- e + ) < 5.2 x 10~ 10 together with 
BR(K + —7- 7r°/i + ^) = (3.35 ± 0.04) x 10 -2 give lower limits of the gauge boson mass ?nji2 as 
shown in Table 1. Note that the mode ET + — >■ Tr+e+yU - has | AA^j| = 2, which we are interested 
in, while the mode K + — > 7r + e~/x + has (AA^jl = 0. We can estimate lower bounds of other 
gauge boson masses, m/n, m/13, etc., from the lower bounds of mji2 using the relation (8). 
The results are listed in Table 1. In the present model, the mass m/33 of the heaviest gauge 
boson ^3 is predicted in the 10 2 -10 3 TeV range. On the other hand, the lower bound of ^^33 
estimated from K + — > 7r + e~/i + is 300 TeV as seen in Table 1. Therefore, the lower bound of 
each gauge boson listed in Table 1 seems to be almost near to its upper bound. In other words, 
the mass values given in Table 1 suggest that experimental observations of family gauge boson 
effects soon become within our reach. If we consider, however, a more general mixing of the 
down-type quarks, we obtain suppression factors to the above branching ratios. In this case, 
constraints to the gauge boson masses become looser. 

A constraint on mfi2 can also be obtained from the observed value of the K°-K° mixing. 
The prediction for the K°-K° mixing in the present model is more sensitive to the mixing of 
the down-type quarks than for the rare kaon decays. Even with the simple ansatz eq. (jlip . 
the prediction depends on the value of 6. Hence, first we present the prediction in the no- 
mixing case {6 = 0) as a reference for small mixing, and afterwards we discuss the case with a 
general down- type quark mixing. In contrast to the (V — A)(V — A)-type effective interaction 
[57^(1 — 75)d][s7 M (l — 75 )d] induced in conventional models, the present model induces the 



(V -A)(V + A)-type effective interaction [s-y^l - 7 5 )<i][s7^(l + j 5 )d\. This leads to the K°-K° 
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(K°\s lfl (l - 75 )d|0) (01^(1 -7B)d\K°) (15) 

3 V^s + rnd, 

under the vacuum saturation approximation, which should be compared with 

| (^°|I7m(1 " 75)d|0)(0|l 7 ^(l - l5 )d\K°) (16) 

in the conventional case. With eq. fjl5[> we find a lower bound for m/12 of order 10 3 TeV, which 
serves as a reference for small down-type quark mixing. We note that this bound is much more 
stringent than the values listed in Table 1 (although it may still not completely rule out the 
model if we take into account uncertainties in the estimate of the unification scale in the model). 
If we take into account a general mixing of the down-type quarks, the prediction for the 
K°-K° mixing can be either larger or smaller. In particular, in the case that the mixing matrices 
UdL and UdR are complex, without specific tuning of the matrices, generally a very stringent 
constraint is imposed from the CP violation in the K°-K° mixing: rrif 12 ^ 10 5 TeV [5], which 
rules out the present model. On the other hand, there exists a parameter region (parametrized 
by a set of continuous parameters), where the contribution to the K°-K° mixing vanishes. Even 
if we restrict the mixing matrices to real (orthogonal) matrices, such solutions exist with rather 
simple forms. For instance, in the case UdR = 1 and 



U dL e 



(17) 

(sg = sin#,ce = cos# for V0), the induced four-Fermi operator for the K°-K° mixing vanishes 
due to the characteristic form of the family gauge interactions |fj In general (but restricting to 
orthogonal mixing matrices to circumvent constraints from the CP violation), if the mixing 
induces a coupling of the d-s current to the lightest gauge boson A\, the K°-K° mixing tends 
to be more enhanced and the bounds for the gauge boson masses tend to be severer. For certain 
choices of the mixing matrices, [e.g. UdR sufficiently close to 1 and UdL to eq. (fT7]) ]. the induced 
four-Fermi operators are suppressed, and the lower bound for m^yi can be reduced much below 
10 3 TeV. 

Let us briefly discuss bounds from the observed D°-D° mixing. In order to predict contri- 
butions of family gauge boson exchanges to the D°-D° mixing, we need to know the mixing ma- 
trices for the up-type quarks U u l and U u r. Of these, U u l is related to UdL by Vckm = U^ L UdL, 
where Vckm is the Cabibbo-Kobayashi-Maskawa (CKM) matrix, while U u r is unknown. Naively 
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Another example of solutions is UdL — 1 and UdR of the form given in eq. (|17[) . 



Table 1: Masses of the gauge bosons A\, A\, A\ and A%, and their lower bounds from rare kaon 
decays, assuming the down-type quark mixing eq. (jlip . Their relative sizes are also shown. 





m /n 


"1/12 


"1/13 


"1/33 




\/2m e 
0.0981127 
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y/rrifj, + m e 
1.00000 


\Jm T + m e 
4.09154 


\/2m T 
5.78448 


K + — > ir + fi~e + 
K + — > 7r + e~/i + 


2.1 TeV 
5.1 TeV 


21 TeV 
52 TeV 


86 TeV 
210 TeV 


120 TeV 
300 TeV 



the lower bound from the D°-D° mixing on rrif 12 is of order 10 2 -10 3 TeV. Since the constraint 
on CP violation is at present not very tight, the bounds on the CP phases in U u r are not very 
demanding. On the other hand, for U u l corresponding to U^l of eq. (fT7]l . there always exist 
UdR which suppress the induced four-Fermi operator for the D°-D° mixing, although we have 
not found particularly simple forms for the combination U u l and ?7 u rQ We present a detailed 
analysis of the effects of the quark mixing in our future work. 

We also note that if the CKM quark mixing originate from VEV's of scalar fields (with 
non-trivial U(3) charges) other than (<l? e ), in general they may contribute to mixings of family 
gauge bosons, and therefore they would receive a tight constraint from the experimental data 
for the K°-K° mixing. This is, however, highly dependent on the model of the quark sector, in 
comparison to the constraints analyzed aboveO 

We summarize here our standpoint with respect to the constraints on the gauge boson mass 
from the quark sector, namely from the charged kaon decays, K°-K° mixing, and D°-D° mixing. 
The severe constraint from the CP violation in the K°-K° mixing shows that CP phases in the 
down-type quark mixing U^l an d U^r are absent or do not contribute to the K°-K° mixing, for 
the model to be viable. A simple possibility is to constrain U^l an d U^r to be real, and this 
will be assumed in the rest of our analysis. The constraints from the K°-K° mixing and D°-D° 
mixing indicate that m/12 > 10 3 TeV, without tuning of the mixing matrices. These bounds, 
however, can be lowered to order 10 2 TeV (roughly the expected size of this family gauge boson 
mass) in a non-negligible region of the parameter space of the mixing matrices. In order to 
reduce mfi2 to a much lower mass range, naively it seems to require considerable fine tuning 
of the mixing matrices. Nevertheless, given the simple forms of the down-type quark mixing 
eq. (fT7|) . we may as well keep our mind open for a possibility that Nature indeed conspires to 
realize such a case. 

As seen above, the bounds for rrifyi extracted from the quark sector are quite dependent on 
the structure of the quark mixing matrices. By contrast, a strict bound can be extracted from a 



4 This is partly due to the fact that we do not know what can be regarded as "simple" forms, given the 
constraint Vckm = U uL Udh by the present experimental data. 

5 Introduction of other [7(3)-breaking scalar VEV's is not mandatory for generating CKM quark mixing. For 
instance, quark mass matrix can be generated from & e Sq&^ , where S q has only 0(3) charge and off-diagonal; 
this form is similar to the lepton mass matrix of the present model. [S q may even have a non-trivial CP-phase, 
since C/(3) x 0(3) is embedded into [7(9).] 



purely leptonic process independently of the quark sector, since the interactions of the charged 
leptons with the family gauge bosons are completely fixed. In passing, let us comment on the 
leptonic processes [i — > 3e and \i — > &y. The effective interaction (jlOp include only |AiVy| = 
and | Ai\fy| = 2 terms, whereas these processes have |AiVy| = 1. Hence, these processes can occur 
only through family mixing in quark loops. They are dependent on the quark mixing matrices; 
furthermore, the constraints from these processes are looser than other quark-mixing dependent 
ones which we considered above. Therefore, we do not discuss /x — > 3 e and /i — > &y any further. 
Here, we consider the muonium into antimuonium conversion M(/i + e~) — > M(/z~e + ), which has 
|AiVj| = 2. The total MM conversion probability P m jj(B) under an external magnetic field 
B is given by P m jj(B) = 5 2 /2[5 2 + (Em — Ejj) 2 + A 2 ], where Em and Ejj are the energies of 
M and M, respectively, A is the bound muon decay width, and 5 is defined by (M \H m jj\M) 
which is proportional to (Gf^/vty/iTa? (a is the electron Bohr radius). Here, the effective 
interaction describing MM conversion is given by eq.(4). This has the same (V — A)(V + A) 
form as the one corresponding to a dilepton model [10], and the formulation in this case has 
been investigated by Horikawa and Sasaki [11] in detail. It predicts Pmm(®) — (3/2)<5 2 /A 2 and 
5 = -8(G / i 2 /v / 2)(l/vra 3 ). It follows that 

For example, for m fl2 = 21 TeV and 52 TeV, eq. flU]) predicts P A/I7 (0) = 3.6 x 10" 15 and 
9.6 x 10~ 17 , respectively. Present experimental limit [12] of the total conversion probability 
integrated over all decay times is P m jj(B) < 8.3 x 10 -11 (90% CL) for B = 0.1 T. Since 
5 B (0.1T) = 0.78 for the case of (V - A)(V + A) [II], where S B (B) is defined by P M m( B ) = 
P MJ! (0)S B (B), this bound leads to P M m^) < L 06 x 10~ 10 , and to G fl2 /G F < 2.3 x 10~ 3 . 
Thus, the lower bound of myi2 is given by 

m/12 > 20m w = 1.6 TeV. (19) 

This constraint is looser than the constraints listed in Table 1 or from the K°-K /D°-D mixing. 
However, since the down-quark mixing matrices U^l an d U^r are unknown at present apart from 
the CKM matrix, we would like to emphasize the importance of observations in the pure leptonic 
processes, independently of the bounds from the rare kaon decays. In this respect, we expect 
that future experiments will improve the bounds given in eq. (11911 . 



3 Search for signatures at collider experiments 

Next, we investigate possible signatures of the current-current interaction with |AA^j| = 2 at 
collider experiments. Although a top-top production at LHC (via u+u — > t+t) is very attractive, 
the cross section ~ 10~ 6 pb at ^/s = 14 TeV and for rrifis = 10 2 TeV would be too small to 
detect the signal. The cross section for e~ + p — > fi~ + X amounts toa~ 10 -5 pb at E p = 7 
TeV and E e = 400 GeV for rrif\2 = 50 TeV, which would also be difficult to detect, because of 
a large background e~ + p — > pT + v e + v^ + p with a ~ 10 _1 pb. 
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Figure 1: Differential cross section da(e^e^ — > [i~/i~)/dcos9 vs. cos#. We set yfs = 2 TeV and 
771 /i2 =10, 35, and 70 TeV. The light-shaded and dark-shaded regions represent the constraints 
from rare kaon decays listed in Table 1, which assume the down- type quark mixing eq. (|11|) . 



Table 2: Cross sections for the signal and Drell-Yan background, and S/\f N corresponding to 
an integrated luminosity of 1 fb -1 , at LHC \fs = 14 TeV. No cuts are imposed. 



m 



/n(TeV) signal (fb) DY BG (fb) S/VN 



4.4 x 10 2 
4.2 x 10 



1.6 x 10" 1 
1.5 x 10~ 2 



1.1 x 10 3 
3.4 x 10 2 



The most clean reaction with |AiVf| = 2 is e~ + e~ — > fi~ + /i~. This reaction is expected 
at an optional experiment at a future e + e~ linear collider. The current structure in this model 
shows that this reaction takes place only between invertedly polarized electron pairs ej^ e^. This 
aspect is useful for discriminating this model from others using the polarized e~ beams. We 
obtain the differential cross section 



da 



dcosO 



27ra EM s(1 + cos 2 ( 



111 



(20) 



/12 



and the total cross section ^(e^e^ — > fj,~~fi~) = (167ra 2 5M /3m'r 12 ),s. Fig. 1 shows the differential 
cross sections da(e^e^ { — > /z~ fi~)/dcos 6 at the cm. energy y/s = 2 TeV. The value of the family 
gauge boson mass rra/12 corresponding to each line is displayed in the figure. For mji2 = 21 TeV 
(52 TeV) and at ^/s = 2 TeV, the total cross section is given by a = 3.3 x 10~ 2 (8.7 x 10~ 4 ) fb. 
A high luminosity operation of a future lepton collider may lead to the model confirmation by 
observing the clean reaction with |AiV^| = 2. 

Finally, we discuss a search for the gauge boson A\, which is the lightest one of the U(3) 
family gauge bosons. For simplicity, we neglect the up-quark mixing as well as down-quark 
mixing, i.e. (u±, U2, U3) ~ (u, c, t) and (d±, cfo, ^3) — (d, s, b). The method is practically the same 
as that for Z' boson. [For reviews of Z', see, for instance, Refs. [13]. In particular, the highest 
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Figure 2: a(pp — > A\X) • BR(j4J — > e + e ) as a function of the family gauge boson mass ran\. 
The light-shaded (dark-shaded) region is the same as in Fig. 1. 



limit of Z' mass from direct searches is about 1 TeV, which is much smaller than the bounds 
on mfii in Table 1.] In conventional Z' models, Z' couples to fermions of all flavors, whereas 



the ^4} boson couples only to the first generation, i.e., A\ 
width and the branching ratio are given, respectively, by 



e + e , v e v e , uu, dd. The total decay 



T{A\ ->■ all) 
BR(A\ 



(5/16ir)gjmfn 

e + e -) = 2/15, 



5 a em m 



/ii> 



(21) 



which are different from those of conventional Z' models. Since we presume that A\ has a 
mass larger than 0(1 TeV), it is not expected to find A\ at Tevatron. On the other hand, we 
may expect productions of A\ at LHC. In Fig. 2, we show the cross section a(pp — > A\ X — > 
e + e~X) = a{pp ->■ A\X) ■ BR(A\ -)■ e+e") for ^ = 7 TeV and 14 TeV. The cross sections 
are calculated with CalcHEP pTJ] implementing eq. fl2J) and with the CTEQ6L code [15] for the 
parton distribution function. When we reconstruct dilepton invariant masses m{l + l~), if we 
observe a peak in m(e + e~) but no peak in m(/U + /x~), this will be a signal of the new gauge 
boson A\. (This feature is unchanged even with up-quark mixing.) 

The dominant backgrounds in the A\ search, after moderate event selection cuts, are Drell- 
Yan dielectrons [16]. Table 2 lists S/yN as a measure of A\ discovery reach for m/n < 3 TeV. 
Estimates of backgrounds within a window of ±4r^' ~ il^i before any cut are taken from 
|16| . Comparing to the analysis given there, we anticipate that, with an integrated luminosity of 
10 fb , m/ii up to several TeV would be within discovery reach. However, we leave a detailed 
study to our future work. 



4 Summary 

At present, the cancellation mechanism based on U(3) family gauge symmetry is the only known 
one as a possible explanation for K (fj,) = K pole . Therefore, tests of the model are urgently 



required. 

In this model, the family number i = (1,2,3) is defined as (ei,e2,es) = (e,//, r) in the 
charged lepton sector. Once we fix the mass matrix (or the mixing matrix) of the down-type 
quarks in this basis, we can extract constraints on the family gauge boson masses from the 
rare kaon decay searches and from the observed value of the K°-K° mixing. Similarly if we 
fix the up-type quark mixing, we can extract constraints from the D°-D° mixing. The very 
stringent bounds from the CP violation in the K°-K° mixing rule out contributions from CP 
phases in the down-type quark mixing matrices to this process. Hence, we restrict our analysis 
to the real (orthogonal) down-type quark mixing matrices. Generally (without tuning of the 
mixing matrices) we find mf\2 > 10 3 TeV from the K°-K° and D°-D° mixing. However, 
m/12 ~ O(10 2 TeV) is also viable in a non- negligible range in the parameter space of the mixing 
matrices, which is consistent with the bounds from the rare kaon decay searches. We also find 
that, with certain simple forms of the down-type quark mixing matrices, the contribution of the 
family gauge bosons to the K°-K° mixing vanishes. Strictly speaking, if we allow for an arbitrary 
quark mixing, we cannot constrain the gauge boson masses from these experimental data, since 
there exist solutions, for which all these processes are suppressed. A quark- mixing independent 
bound is obtained from a purely leptonic process, muonium-antimuonium conversion, whose 
current lower bound reads rrifi2 > 1.6 TeV. More sensitive tests will come from an upgrade of 
this experiment or from the process e^e^ —> ^^ at ILC. Furthermore, if the lightest gauge 
boson A\ happens to exist below several TeV, we expect to observe a peak in m(e + e~) but no 
peak in m(n + n~) at LHC. These searches may uncover an interesting possibility. 

One may suspect that the bounds from the K°-K° mixing are too severe for the new physics 
signals to be observed at LHC and/or ILC. We note, however, that at present our knowledge on 
the structure of the quark mixing matrices is rather limited, and a conservative attitude would 
be to rely on the current bounds from the purely leptonic process M(/i + e~)-M(e + ^~). In this 
regard, we stress that, although the production rate of A\'s at LHC depends on our assumption 
of the up- and down-quark mixing, once they are produced, the family dependent appearance 
of a peak among the purely leptonic decay channels is independent of the assumption and is a 
unique prediction of the present model. 
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